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Abstract 

Determining the learning quality and the role of measurement and evaluation are accepted as part of the du¬ 
ties and responsibilities of teachers and operators in structured teaching programs. This qualitative case study 
research examined teacher candidates’ conceptual understanding of the reasons for measurement and evalu¬ 
ation and for determining of the learning change to ascertain if trained teacher candidates met the required 
expectations. The study participants were determined using criteria sampling and consisted of 101 science 
teacher candidates. The data was collected using open ended questions, which were analyzed using content 
analysis. The research found that the teacher candidates’ conceptual understanding as to the reasons for evalu¬ 
ation and determining the learning change were inadequate. It was found that the participants were unable 
to relate the measurement and evaluation purposes with learning change, and that the understanding of the 
measurement and evaluation concepts aimed at determining the need for learning change did not coincide. The 
data suggested that there could be teacher training insufficiencies and that the duties and responsibilities of the 
new teaching programs encumbered the teachers. In this context, it was suggested that determining the learn¬ 
ing changes by measurement and evaluation practices be emphasized during teacher training. 
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Over the last five years the teaching programs in 
our country, which had been developed within the 
frame of the European Union adaptation standards, 
have been restructured with regard to learning 
areas and approaches. Newer teaching programs, 
therefore, have improved natures/structures 
(Kurnaz & Qepni, 2012; Milli Egitim Bakanhgi 
[MEB], 2007; Ustiin, Eryilmaz, & Giilyurdu, 2008). 
Therefore, teachers and the operators of teaching 
programs have new important responsibilities with 
regards to the areas of learning and approaches to 


the program (Ate§ et al., 2009; Gunes & Tasar, 2006; 
Serin & Kanli, 2008). This implies that teachers are 
expected to assimilate these renewed learning areas 
and approaches into their teaching, such as the 
constructivist learning approach which requires that 
learners take responsibility for their own learning 
progress while the teachers act as facilitators or 
guides (Cobern, 1993; Karamustafaoglu, Co§tu, & 
Ayas, 2005; Kurnaz & Qalik, 2008, 2009; Mathews, 
2000; Osborne & Wittrock, 1983). 
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Table 1 

Comparison of Assessment Types* 


Aim 


Focus 

Measurement 

Method 

Using the measure¬ 
ment results 

Feedback’s nature 


Diagnostic Formative 

Determining learning re- Deepening 

quirements learning 

Result (What’s known?) Result and process (What’s known?) 

Subsidiary techniques and Subsidiary techniques 
success tests 

Performance improvement Performance improvement 
(structuring the learning en¬ 
vironment) 

Performance Performance 


Timing 

Responsibility 


Beginning of the learning During the learning process 
process 

Teacher Student and teacher 


Summative 

Determining of and judging learn¬ 
ing outcomes 

Last result (How much is known?) 
Success tests 

Decisions on performance 


Grade 

End of the learning process 
Teacher 


* Table is structured from the viewpoint of Harlen (2003), Harlen and James (1997), Jones (2006), Kim (2003), Parker, Fleming, 
Beyerlein, Apple, & Krumsieg (2001), and Odaba§i Qmer (2008) studies. 


For science and technology teaching programs, 
teachers are required to carry out diagnostic, 
formative, and summative measurement and 
evaluation (Kurnaz 8c Qepni, 2012). Therefore, there 
needs to be a change in the way teachers perceive the 
measurement and evaluation process in parallel with 
the new teaching programs, a process which is clearly 
stated in the teaching programs (see also MEB, 2006, 
2013). The key features of the diagnostic, formative, 
and summative assessments are shown in Table 1. 

As shown in Figure 1, a teacher needs to first 
conduct a diagnostic assessment to determine 
a students present knowledge. From the data 
obtained, a formative assessment is conducted 
to enable a deepening of the learning. Finally, a 
summative assessment is conducted to determine 
the students acquisition, recognize the learning 
change, and identify learning gaps. What is new 
here is the need for the diagnostic assessment at the 
start of the learning process and determining the 
learning changes. As stated above, the diagnostic 
assessment is related to understanding the extent of 
a student s prior knowledge. 



Figure 1: Application of diagnostic, formative, and summative 
assessments to learning environments. 


According to Hailikari (2009), prior knowledge 
is used for (I) determining the students level, (II) 
determining the class aims, and (III) designing 
the student learning environment. In recent 
research, it has been observed that students’ 
prior knowledge level should be considered for 
determining learning change (Hake, 2002a, 2002b; 
Ladd & Walsh, 2012; Meltzer, 2002; Thompson, 
2008; Zeilik, 2012). The effect of prior knowledge 
has been observed as an obstacle in determining 
learning change if only a single test is held at the 
completion of the subject area, so an evaluation 
technique which is able to reveal the real effects of 
the learning environment through the comparison 
of pretest and posttest results is preferred. Hake 
(1998) suggested a normalized gain formula [g = 
(posttest score - pretest score) / (maximum score 
- pretest score)] for this process. According to 
this formula, normalized gain values fall between 
0 (acquisition/no acquisition) and 1 (all possible 
acquisitions/acquisitions gained). By determining 
the normalized gain, the real change in education 
can be revealed (Meltzer, 2002), a technique that 
has been discussed in a number of previous studies 
(see Hake, 1998, 2002a, 2002b; Kalkan 8c Kiroglu, 
2007; Ladd 8c Walsh, 2012; Thompson, 2008; Zeilik, 
Schau, 8c Mattern, 1998). With reference to this 
diagnostic assessment, the conditions suitable for 
determining learning change are identified in this 
paper. 

From the literature review, teacher candidate 
knowledge regarding new assessment and evaluation 
approaches activated within the curriculum (e.g., 
Birgin 8c Giirbuz, 2008; Saglam-Arslan, Avci, 8c 
iyibil, 2008; Ta§hdere 8c Ozsevge^, 2012; Ye§ilyurt 
8c Yara§, 2011), developed through training in 
assessment and evaluation (e.g., Arslan 8c Ozpinar, 
2008; Ugurlu 8c Akko<;, 2011) and promoted through 
self-sufficiency(e.g., Kilinq:, 2011; Mert Uyangor 
8c Kobak, 2012 Yaman 8c Karamustafaoglu, 2011) 
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Table 2 

Comparing the Reason of Measurement and the Intended Use of Measurement Results with the Reason of Evaluation 



Reason of evaluation 

Determining 
the student 
acquisition 

Determining 

change 

Grading 

Teaching 

method 

Determining 
the learning 
deficiency 

Deciding 
on the 

success 

Other 


Determining the change 

29 

31 

1 

- 

1 

12 

3 

c 

OJ 

6 

<u 

3 

Recognizing the effective¬ 
ness of the learning envi¬ 
ronment 

12 

8 




5 

1 

s 

s 

By regulations 

6 

1 

1 

- 




£ 

Cl 

o 

8 

Need for objective eval¬ 
uation 

1 

1 

1 

- 


2 


Pi 

Grading 

1 

1 

1 

1 





Teaching method 

1 

1 

1 

- 




<D 

Determining the success 
level 

19 

21 

2 

- 


5 

2 

C 

OJ 

Giving feedback 

14 

11 

- 

- 

- 

4 


<D 

5 

3 

OJ 

Supervising teaching 
activities 

12 

6 

1 

- 

1 

7 

1 

o 

Grading 

5 

2 

1 

1 


3 


3 

Student evaluation 


3 

1 

- 


1 

1 


are analyzed. However, there have been few studies 
which that have examined the determination 
of learning change and the reasons for certain 
assessment or evaluation procedures. 

At the end of their training, teacher candidates are 
expected to know how to determine learning changes 
and how to interpret the measurement and evaluation 
measures. This research analyzed science teacher 
candidates conceptual interpretation of the reasons 
for the measurement and evaluation measures and the 
need for determining the learning change. 

Method 

The research was carried out from a qualitative 
perspective and a case study was used as the 
research method (Yin, 2003). The research focus 
was an assessment of the science teacher candidates’ 
conceptual understanding of the measurement and 
evaluation measures. 

Study Group 

The participants were 101 final grade science teacher 
candidates. The study group was determined using 
criteria sampling, one of the purposeful sampling 
methods. The criteria used to select this study group 
were; (I) being in the final grade and (II) having 
successfully passed the measurement-evaluation 
course related to this research subject. 


Data Collection Tool 

6 open ended questions were used as the data 
collection tool to reveal the teacher candidates’ 
understanding of the research subject. The reason for 
the use of open ended questions was to gain deeper 
information about the subject without needing 
to lead the teacher candidates (White & Gustone, 
1992). The questions were given to 15 teacher 
candidates and the deficiencies were examined in 
parallel with an expert. The teacher candidates were 
given 30 minutes to answer the questions. 

Analyzing the Data 

A content analysis method was used to analyze 
the research data. During the analyses, another 
researcher with experience in qualitative research 
was consulted. Both researchers working 
independently conducted the analyses over 
three phases (/-naming phase, //-classification/ 
elimination phase, ///-category development phase) 
Then, working together, the researchers discussed 
the coding for the “agreed” and “dissented” items. 
Then, the reliability calculation formula suggested 
by Miles and Huberman (1994) was used to analyze 
the researchers correspondence percentage [R reliability 
= agreement / (agreement + dissidence)], which 
was calculated to be 88%. 


^ 1990 
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Table 3 


Comparison of Interpretations regarding the Diagnostic Measurement and Evaluation and the Determination of Learning Changes 


Quality of pretest 

Determining 

foreknowledge 

Designing learning 
environment 

Determining Change 

Informing about the subject 

Pre-post test result comparison 

39 

9 

3 

2 

Process observation 

29 

5 

3 

1 

With grade/test 

8 

5 

4 

1 

Alternative techniques 

6 


2 


Other 

4 

3 

1 

1 


Findings 

Conceptual Understanding Related to the Reason 
for the Measurement and Evaluation measures 

The teacher candidates’ understanding for the 
reason for the measurement and evaluation 
measures and the intended use of the measurement 
results were compared, as shown in Table 2. 

Determining the Student Change and Conceptual 
Understanding regarding the Diagnostic 
Assessment 

The teacher candidates’ understanding regarding 
the diagnostic assessment and the determination of 
learning changes were compared, as shown in Table 3. 

Teacher candidates’ answers about the relationship 
between the diagnostic assessment and the 
determination and recognition of learning change 
were then tabulated, as shown in Table 4. 


Table 4 

The Case of Teacher Candidates’ Evaluating Sampl 
ment Results 

e Assess- 

Top theme 

Sub Theme 

Code 

f 

% 

Determining 

learning 

Change 

Successful 

evaluation 

Considering the 
pre and post test 
result compar¬ 
ison 

88 

88 

Unsuccessful 

evaluation 

Considering 
level difference 

13 

13 


Discussion 

Determining the features or qualifications of 
the target object or individual is classified as 
assessment, while making judgments or comments 
about that object or individual is classified as 
evaluation (Semerci, 2008; Ya§ar, 2008). The teacher 
candidates in the study were able to judge the 
quality of assessment, but did not make judgments 
or decisions about the evaluation, and instead relied 
on measuring the change in the students’ learning 
through assessment only. Further, understanding 
regarding the use of the evaluation results and 


the conceptual understanding of the reason for 
the evaluation did not coincide. The conceptual 
understanding of some teacher candidates about 
the reason for the measurement and evaluation 
did coincide, but these tended to be interpreted 
as having the same concepts. These findings 
highlighted that the science teacher candidates’ 
understanding of the conceptual relationship 
between measurement and evaluation was not 
scientific because of a deficiency in understanding 
the reason for structured evaluation. These findings 
are similar to the results of previous studies (Arslan 
8c Ozpinar, 2008; Birgin & Giirbuz, 2008; Mert 
Uyangor 8c Kobak, 2012; Usta, Dikyol 8c ince, 2010; 
Yaman 8c Karamustafaoglu, 2011). 

Some candidates were found to attribute the same 
meaning to both measurement and evaluation. 
These findings indicate that the teacher candidates 
participating in this research were expected to start 
their careers without a qualified understanding 
of the measurement and evaluation measures 
being used. Because of the effect of assessment 
and evaluation on learning performance (Black 
8c Wiliam, 1998; Struyven, Dochy, 8c Janssens, 
2005), it is clear that teacher candidates should 
be well trained in the assessment and evaluation 
procedures, and so undergraduate teaching 
practices should be revised to reflect the aims of the 
new teaching programs. 

The aim of a diagnostic assessment activity 
is to gather information about the students’ 
foreknowledge and, in this research, it was found 
that the teacher candidates understood this 
aim well. However, the fact that only one fifth 
of the teacher candidates related the diagnostic 
measurement and evaluation measures with the 
structuring of the learning environment highlighted 
a deficiency in this area. Another surprising aspect 
was that the features of the diagnostic measurement 
and evaluation which allowed for a determination 
of the student’s learning change (Hake, 1998, 
2002a, 2002b; Ladd 8c Wals, 2012; Meltzer, 2002; 
Thompson, 2008; Zeilik, 2012) was understood by 
only one tenth of the research participants. After 
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analyzing the conceptual understanding of the 
determination of student learning change, nearly 
half the research participants considered that the 
pretest-posttest data was sufficient to determine 
learning change, so the reason for the diagnostic 
measurement and the evaluation were not clear 
to them. Therefore, the candidates appeared to 
have no clear conceptual understanding about the 
measurement and evaluation measures required for 
determining and defining a learning change. 

When the candidates’ understanding related 
to the reason for the role of measurement and 
evaluation and for determining the learning change 
were considered together, the candidates focused 
only on the measurement activity. Therefore, the 
candidates did not appear to have a conceptual 
understanding as to how to create coherence 
between the diagnostic, formative, and summative 
assessments, which are a necessary part of the new 
teaching programs. 


Therefore, from these findings, there are obvious 
deficiencies in the teacher training for new 
candidates with regards to the expectations in the 
new teaching program. Accordingly, it is suggested 
that the findings of this research be used to advise 
present teacher training to attach more importance 
to the measurement of learning change. 

This research study had some limitations. The 
two main limitations are that the research was 
conducted on only a small group of participants, 
and there was only one data collection process 
used. By supporting this study with the results of 
other studies carried out over a longer time with a 
wider range of data collecting tools, these findings 
could be more generalizable, thus contributing 
more to the field. 


^ 1992 
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